Shannon's entropy in exponential families: Statistical applications
نویسندگان
چکیده
منابع مشابه
Review of the Applications of Exponential Family in Statistical Inference
In this paper, after introducing exponential family and a history of work done by researchers in the field of statistics, some applications of this family in statistical inference especially in estimation problem,statistical hypothesis testing and statistical information theory concepts will be discussed.
متن کاملGeneralized Statistical Methods for Mixed Exponential Families, Part II: Applications
This work considers the problem of both supervised and unsupervised classification for vector data of mixed types. An important subclass of graphical modeling techniques called Generalized Linear Statistics (GLS) is used to capture the underlying statistical structure of these complex data. The GLS methodology exploits the split between data space and natural parameter space for exponential fam...
متن کاملGeneralised Exponential Families and Associated Entropy Functions
A generalised notion of exponential families is introduced. It is based on the variational principle, borrowed from statistical physics. It is shown that inequivalent generalised entropy functions lead to distinct generalised exponential families. The well-known result that the inequality of Cramér and Rao becomes an equality in the case of an exponential family can be generalised. However, thi...
متن کاملChapter 6 Exponential families and maximum entropy
In this set of notes, we give a very brief introduction to exponential family models, which are a broad class of distributions that have been extensively studied in the statistics literature [4, 1, 2, 7]. There are deep connections between exponential families, convex analysis [7], and information geometry and the geometry of probability measures [1], and we will only touch briefly on a few of ...
متن کاملExponential Families and MaxEnt Calculations for Entropy Measures of Statistical Physics
For a wide range of entropy measures, easy calculation of equilibria is possible using a principle of Game Theoretical Equilibrium related to Jaynes Maximum Entropy Principle. This follows previous work of the author and relates to Naudts [1], [2], and, partly, Abe and Bagci [3].
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied Mathematics Letters
سال: 2000
ISSN: 0893-9659
DOI: 10.1016/s0893-9659(99)00142-1